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Abstract 

o 

The paper is concerned with optimal control of backward stochastic differen- 
tial equation (BSDE) driven by Teugel's martingales and an independent multi- 
dimensional Brownian motion, where Teugel's martingales are a family of pairwise 
strongly orthonormal martingales associated with Levy processes (see Nualart and 
Schoutens [Mj). We derive the necessary and sufficient conditions for the existence 
of the optimal control by means of convex variation methods and duality techniques. 
' As an application, the optimal control problem of linear backward stochastic dif- 

'sj" . ferential equation with a quadratic cost criteria (called backward linear-quadratic 

problem, or BLQ problem for short) is discussed and characterized by stochastic 
Hamilton system. 
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1 Introduction 

It is well known that the maximum principle for a stochastic optimal control problem 
involves the so-called adjoint processes which solve the corresponding adjoint equation. In 
fact, the adjoint equation is in general a linear backward stochastic differential equation 
(BSDE) with a specified a random terminal condition on the state. Unlike a forward 
stochastic differential equation, the solution of a BSDE is a pair of adapted solutions. 
Thus, in order to obtain the maximum principle, we need first obtain the existence and 
uniqueness theorem for the pair of adapted solutions of adjoint equation. 
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The linear BSDE was first proposed by Bismut |1] in 1973. This research field devel- 
oped fast after the pioneer work of Pardoux and Peng [TB] in 1990 got the existence and 
uniqueness theorem for the solution of nonlinear BSDE driven by Brownian motion under 
Lipschitz condition. Now BSDE theory has been playing a key role not only in dealing 
with stochastic optimal control problems, but in mathematical finance, particularly in 
hedging and nonlinear pricing theory for imperfect market (see e.g. [Tj). 

As for BSDE driven by the non-continuous martingale. Tang and Li [20] first discussed 
the existence and uniqueness theorem of the solution of BSDE driven by Poisson point 
process and consequently proved the maximum principle for optimal control of stochas- 
tic systems with random jumps. In 2000, Nualart and Schoutens [14j got a martingale 
representation theorem for a type of Levy processes through Teugel's martingales, where 
Teugel's martingales are a family of pairwise strongly orthonormal martingales associated 
with Levy processes. Later, they proved in [15j the existence and uniqueness theory of 
BSDE driven by Teugel's martingales. The above results are further extended to the one- 
dimensional BSDE driven by Teugel's martingales and an independent multi-dimensional 
Brownian motion by Bahlali et al [1] . One can refer to [SI [9l [T71 [18] for more results on 
such kind of BSDEs. 

In the mean time, the stochastic optimal control problems related to Teugel's martin- 
gales were studied. In 2008, a stochastic linear-quadratic problem with Levy processes 
was considered by Mitsui and Tabata [13], in which they established the closeness prop- 
erty of multi-dimensional backward stochastic Riccati differential equation(BSRDE) with 
Teugel's martingales and proved the existence and uniqueness of solution to such kind of 
one- dimensional BSRDE, moreover, in their paper an application of BSDE to a financial 
problem with full and partial observations was demonstrated. Motivated by [13], Meng 
and Tang [12] studied the general stochastic optimal control problem for the forward 
stochastic systems driven by Teugel's martingales and an independent multi-dimensional 
Brownian motion, of which the necessary and sufficient optimality conditions in the form 
of stochastic maximum principle with the convex control domain are obtained. 

However, [12] and [13] are only concerned with the optimal control problem of the 
forward controlled stochastic system. Since a BSDE is a well-defined dynamic system 
itself and has important applications in mathematical finance, it is necessary and natural 
to consider the optimal control problem of BSDE. Actually, there has been much literature 
on BSDE control system driven by Brownian motion (see e.g. [21 [3l El [HI [10] ) . But to our 
best knowledge, there is no discussion on the optimal control problem of BSDE driven by 
Teugel martingales and an independent Brownian motion, which motives us to write this 
paper. 

In this paper, by means of convex variation methods and duality techniques, we will 
give the necessary and sufficient conditions for the existence of the optimal control for 
BSDE system driven by Teugel martingales and an independent multi-dimensional Brow- 
nian motion. As an application, the optimal control for linear backward stochastic differ- 
ential equation with a quadratic cost criteria or called backward linear-quadratic (BLQ) 
problem is discussed in details. The optimal control of BLQ problem will be characterized 
by stochastic Hamilton systems. In this case, the stochastic Hamilton system is a linear 
forward-backward stochastic differential equation driven by Teugel's martingales and an 
independent multi-dimensional Brownian motion, consisting of the state equation, the 
adjoint equation and the dual presentation of the optimal control. 
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The rest of this paper is organized as follows. In section 2, we introduce useful notation 
and some existing results on stochastic differential equations (SDEs) and BSDEs driven 
by Teugel's martingales. In section 3, we state the optimal control problem we study, 
give needed assumptions and prove some preliminary results on variational equation and 
variational inequality. In section 4, we prove the necessary and sufficient optimality 
conditions for the optimal control problem put forward in section 3. As an application, 
the optimal control for BLQ problem is discussed in section 5. 



2 Notation and preliminaries 



Let {<^t}o<t<T, P) be a complete probability space. The filtration {^t}o<t<T is 

right- continuous and generated by a d-dimcnsional standard Brownian motion {W{t), < 
t <T} and a one-dimensional Levy process {L{t), <t < T}. It is known that L{t) has 
a characteristic function of the form 



iaOt - -a^eH + t 



A9x 



i9xl{\x\<i))v{dx) 



where a e R^, cr > and u is a measure on M} satisfying (i) / {1 /\x'^)v{dx) < oo and (ii) 

Jo 



there exists £ > and A > 0, s.t. 



e'^^^^v{dx) < oo. These settings imply that the 



random variables L{t) have moments of all orders. Denote by the predictable sub-o" 
field of j3§{[0,T]) X then we introduce the following notation used throughout this 
paper. 

• H: a, Hilbert space with norm || • 

• {a, f3) : the inner product in R", Va, /3 G R". 

• \a\ = ^{a,a) : the norm of R", Va G R". 

• {A, B) = tr{AB^) : the inner product in 

• I A| = ^tr{AA^) : the norm of R"^™, WA G 

72. 



Dnxm 
pnxm 



,yA,B G 



/ : the space of all real- valued sequences x = {xn)n>o satisfying 



Mp - 



\ i=l 



1^{H) : the space of all H- valued sequence / = {/*}i>i satisfying 



P{H) 



• P^(0,T,H) : the space of all Z^(if)-valued and ^(-predictable processes / 
{fit, to), {t,uj) G [0,r] X 0},>i satisfying 



1%{0,T,H) 



rEiifwii^^^<oo. 

•^0 i=l 
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• M^(0, T] H) : the space of all iJ- valued and ^radapted processes / = {fit, w), (t, u) G 
[0,T] X satisfying 



MUo,T;H) = J E 1^ \\f{t)\\Ut <oo. 



• 5^(0, T; if) : the space of all i^f-valued and .^j-adapted cadlag processes / 
{fit, to), it,uj) G [0,T] X n} satisfying 



SUO,T;H) = JE sup \\fit)\\Hdt < +00. 
Y 0<t<T 

• L'^iQ, ^ , P; H) : the space of all //-valued random variables ^ on (fi, P) satis- 
fying 

We denote by {i/*(t), < t < T}^^ the Teugel's martingales associated with the Levy 
process {Lit), <t < T}. H^t) is given by 

Wit) = Q,r«(t) + Q,_ir(*-i)(t) + ■ ■ ■ + Q,iy(i)(t), 

where Y^^\t) = L^^\t) — E[L^^\t)] for all i > 1, L^^\t) are so called power-jump processes 
with L^^\t) = Lit), L^^\t) = (AL(s))* for 2 > 2 and the coefficients Cij correspond to 

0<s<i 

the orthonormalization of polynomials 1, x, x^, - ■ ■ w.r.t. the measure /i((ix) = x^vidx) + 
a'^Soidx). The Teugel's martingales {H\t)}'^i are pathwise strongly orthogonal and their 
predictable quadratic variation processes are given by 

{H^'\t),H^^\t)) = 6,,t 

For more details of Teugel's martingales, we invite the reader to consult Nualart and 
Schoutens [Tit ITS]. 

In what follows, we will state some basic results on SDE and BSDE driven by Teugel's 
martingales {i/*(t),0 < t < T}'^^ and the dimensional Brownian motion {Wit),0 < 
t < T}. 

Consider SDE: 

rt d. „t 

Xit)= a+ bis,Xis))ds + y2 g\s, Xis))dW\s) 
Jo .-I Jo 



'0 i=l 

OO „t 



+ V / a\s,Xis-))dWis), te [o,r], 

i=l 



(2.1) 



where (a, h, g, a) are given mappings satisfying the assumptions below. 

Assumption 2.1. Random variable a is ^o-Hieasurable and ib,g,a) are three random 
mappings 

b:[0,T]xnx M" — > W, 
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g ^ {g\ g\... , : [0, T] x 1] x 

a = {a')Zi : [0, T] X 1] X M" ^ /^(M") 

satisfying 

(i) b, g and a are ^ (g) ^(M") measurable with 0) G M^(0, T; M"), ^(■, 0) G M^(0, T; M"^'^) 
and (t(-,0) G /^(0,r;M"). 

(ii) b,g and a are uniformly Lipschitz continuous w.r.t. x, i.e. there exists a constant 
C > s.t. for all (t, x, x) G [0, T] x x and a.s. u e 

\b{t, x) — b{t, x) \ + \g{t,x) — g{t, x) \ + \ \<j{t, x) — cr(t, x)\\i2(^^n) < C\x — x\. 

Lemma 2.1 ([19j, Existence and Uniqueness Theorem of SDE). // coefficients 
(a, b, g, a) satisfy Assu'mption \2.1\ then SDE (12.11) has a unique solution x{-) G 6*^(0, T; M"). 

Lemma 2.2 ( |12] . Continuous Dependence Theorem of SDE). Assume coefficients 
{a,b,g,a) and {a,b,g,a) satisfy Assumption \2.1[ If x{-) and x{-) are the solutions to SDE 
(12.11) corresponding to {a,b,g,a) and {a,b,g,a), respectively, then we have 



E sup \x{t) - < K 

0<t<T 



a-ap + E / \b{t,x{t)) - b{t,x{t))\'^dt 



+E \g{t,x{t))-g{t,x{t))\'dt 



+E 



T 



\a{t,x{t)) - a{t,x{t))\\f2(Ru)dt 



where K is a positive constant depending only on T and the Lipschitz constant C . 
In particular, for (a, 6, g, a) = (0, 0, 0, 0), we have 



E sup |x(t)|" 

0<t<T 



< K 



\a\^ + E [ \b{t,0)\^dt + E [ \g{t,0)\^dt + E [ \W{t,0)\\l^^„)dt 
Jo Jo Jo 



< +00. 



Now we consider BSDE: 



y 



{t)H+ [ f{s,y{s),q{s),z{s))ds~J2 f 'l'is)dW\s) 
Jt Jt 



f2 r z\s)dH\s), te [0,T], 

i=l Ji 



(2.2) 



where coefficients f) are given mappings satisfying the assumptions below. 
Assumption 2.2. The terminal value ^ G L^(fi, ^t-, P', K"^) and / is a random mapping 

/ : [0, T] X X M" X X /^(M") — y M" 

satisfying 

(i) fis^l^ ^(M'^) (g) (g) measurable with /(-, 0, 0, 0) G M_^(0, T; M'^) 

(ii) / is uniformly Lipschitz continuous w.r.t. {y,q,z), i.e. there exists a constant C > 
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s.t. for all {t,y,q,z,y,q,z) G [0,T] x M" x M"^^ x P(M") x 



X 



\f{t,y,q,z) - f{t,y,q,z)\ < C 



\y -y\ + \<i- <i\ + \\z - ^||p(]R") 



Lemma 2.3 ([T], Existence and Uniqueness of BSDE). If coefficients /) satisfy 
Assumption \2.2l then BSDE (12. 2p has a unique solution 



{yi-),qi-),zi-)) E S%iO,T;W) x M|(0,T; 



nnxd\ 



X /^(0,T;: 



Lemma 2.4 (|1], Continuous Dependence Theorem of BSDE). Assume that co- 
efficients J) and {IJ) satisfy AssumptzonlKM If {y{-), q{-)_, z{-)) and {y{-),q{-),z{-)) 
are the solutions to BSDE (\2.2\i corresponding to /) and /), respectively, then we 
have 



E sup \y{t)-y{t)\^ + E [ \q{t) - q{t)\^ dt + E f \\z{t) - z{t)\\l^^r.^ 

0<t<T Jo Jo 



dt 



< K 



Eli-il-' + E / \f{t,y{t)A{t)rz{t)) - f{t,y{t)Ait)rzm'dt 





where K is a positive constant depending only on T and the Lipschitz constant C . 
In particular, if f) = (0, 0), we have 



E sup \y{t)\'^ + E [ \q{t)\'^dt + E 

0<t<T Jo 



2 rif 



< K 



T 



E\^\^ + E \f{t,0,0,0)\'dt 



(2.3) 



In view of Assumptions 12.1112.21 Lemmas 12.1112.41 follow from an application of Ito's 
formula, Gronwall's inequality and Burkholder-Davis-Gundy inequality. One can refer to 
[1], [12] and for details. 



3 Formulation of the problem and preliminary lem- 
mas 

Let the admissible control set ?7 be a nonempty convex subset of M™. An admissi- 
ble control process «(■) is defined as a ^(-predictable process with values in U s.t. 

E / \u{t)\'^dt < +00. We denote by A the set including all admissible control processes. 
Jo 

For any given admissible control u{-) E A, we consider the following controlled non- 
linear BSDE driven by multi-dimensional Brownian motion W and Teugel's martingales 



y{t) =^ + ^ y^^^' <l{s):z{s),u{s))ds 

q\s)dW\s)-Y, z\s)dH\s), tG[0,r] 

i=l i=l 



(3.1) 



with the cost functional 



J{u{-)) = E 



where 



l{t,y{t),q{t),z{t),u{t))dt + ^y{f))) 



(3.2) 



/ : [o,r] X ^] X 

/ : [0,T] X X 



X 



X 



ixd 



nnxd 



X X U 

X /2(M") X U 



and 



are given coefficients. 

Throughout this paper, we introduce the following basic assumptions on coefficients 

Assumption 3.1. The terminal value ^ G L'^{Q, J^t, P]^^) and the random map- 
ping / is ^ (g) ^(R") (g) ^{W"^) (g) i^(/2(M")) (g) ^(t/) measurable with /(-, 0, 0, 0, 0) G 
M2(0,T;M"). For almost all {t,u) G [0,T] x fi, f{t,uj,y,p,z,u) is Frechet differentiable 
w.r.t. {y,p,z,u) and the corresponding Frechet derivatives fy, fp, fz, fu are continuous 
and uniformly bounded. 

Assumption 3.2. The random mapping / is ^ (g) ^(M") (g) ^(R"^"^) (g) ^(/^(M")) (g ^([/) 
measurable and for almost all {t, u) G [0, T]xQ, I is Frechet differentiable w.r.t. {y,p, z, u) 
with continuous Frechet derivatives ly,lq,lz,lu- The random mapping is ^T'(g<^(I^") 
measurable and for almost all {t,uj) G [0,T] x Q, (p is Frechet differentiable w.r.t. y with 
continuous Frechet derivative (py. Moreover, for almost all {t,u) G [0,T] x Q, there exists 



a constant C s.t. for all {p, q, z, u) G 



anxd 



X 1^{W') X U, 



\l\ < C{l + \y\^ + \q\'^ + \z\'^ + \u\ 



<C{l + \y\ 



\h\ + \h\ + + \lu\ < C(l + \y\ + \q\ + \z\ + \u\) and \(f)y\ < C(l + \y\). 

Under Assumption 13. ![ we can get from Lemma 12.31 that for each u{-) G A, the 
system (13.11) admits a unique strong solution. We denote the strong solution of (13. ip 
by {y^{-),q^{-),z'^{-)), or (y(-), g(-), z(-)) if its dependence on admissible control m(-) is 
clear from context. Then we call {y{-), q{-), z{-)) the state processes corresponding to the 
control process u{-) and call {u{-);y{-),q{-),z{-)) the admissible pair. Furthermore, by 
Assumption 13.21 and a priori estimate (12. 3p . it is easy to check that 

|J«))|<oo. 

Then we put forward the optimal control problem we study. 
Problem 3.1. Find an admissible control ui-) such that 



J{u{-))= MJiui-)). 
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Any «(■) G A satisfying above is called an optimal control process of Problem 13. II and 
the corresponding state processes (y(-), g(-), ^(■)) are called the optimal state processes. 
Correspondingly (u(-); y{-), g(-), z{-)) is called an optimal pair of Problem 13.11 

Before we deduce the necessary and sufficient conditions for the optimal control of 
Problem 13.11 we need do some preparations. Since the control domain U is convex, the 
classical method to get necessary conditions for optimal control processes is the so-called 
convex perturbation method. More precisely, assuming that {u{-);y{-),q{-),z{-)) is an 
optimal pair of Problem 13. H for any given admissible control u{-), we define an admissible 
control in the form of convex variation 

u%.) = u{-)+e{u{-)-u{-)), 

where e > can be chosen sufficiently small. Denoting by {y^ {■) , q"^ {■) , z^ {■)) the state 
processes of the control system (13.11) corresponding to the control process u'^{-), we obtain 
the variational inequality 

JK(-)) - J{ui-)) > 0. 

In what follows, we do some estimates on the optimal pair and the convex variable 
pair. 

Lemma 3.2. Under Assumptions \3.1\\3.2l we have 

E sup \f{t)-y{t)\^ + E I \q%t)-q{t)\^dt + E [ \\z%t) ~ zml^^^^^dt = 0(6^). 

0<t<T Jo Jo 

Proof. By continuous dependence theorem of BSDE (Lemma 12. 4p and the uniformly 
bounded property of Frechet derivative fu, we have 

^ sup \y%t) - + E [ W{t)-q{t)\^dt + E f \\z%t) - -z{t)\\l^^^^^dt 

0<t<T Jo Jo 

rT 

<KE / \f{t,y{t),q{t),z{t),u'{t)) - f{t,mA{t)rz{t)Mt))Ut 



<KE [ \u'{t) -u{t)\'^dt 
Jo 

=KE [ I {u{t) + e{u{t) - u(t)) - u{i))fdt 
Jo 

=Ke^E [ \u{t) -u{t)\'^dt = 0{e'^). 
Jo 



Here and in the rest of this paper, is a generic positive constant and might change from 
line to line. □ 
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Then we consider the following linear BSDE served as a variational equation: 



dY, = - fy{t, y{t),q{t), z{t),Ut)Y{t) + f^{t, y{t), q{t), z{t),Ut)Qt 

+ fz{t, y{t), q(t)rzit),Ut)Z(t) + y{t), q{t), z{t),Ut){uit) - u{t)) 

d 



dt 

(3.3) 



Q\s)dW\s) + J2z\t)dH\t) 

1=1 - i=l 

lF(T) = 0. 

Under Assumption 13.11 by Lemma 12.31 we know that BSDE (13. 3p has a unique solution 



{Y,Q,Z) G 5^(0, r;M") X M^(0,T;R"^'^) x /^(0,r;M"). 
Lemma 3.3. Under Assumptions it follows that 



E sup \f{t) - y{t) - eY{t)\^ + E / \q%t) - q{t) - 6Q{t)\'dt 

0<t<T Jo 

+ E [ \\z%t) - z{t) - eZmkRr.)dt = oie^). 
Jo 



Proof. Firstly, one can check that 

y'it)-y{t) 

T r 



ds 



f^{sWis)-y{s)) + f',{^Wi')-^i')) 
+f%s){z%s) - -zis)) + f^,is)iu%s) - u{s)) 

{Q''is)-<fi-^))dW\s)-Y, {z'%s)--z\s))dH\s) 
i=i i=i 



and 



eY{t) 



fy{s)eY{s) + +f,{s)eQ{s) + fAs)eZ{s) + fu{s)e{u{s) - u{s)) 

d „x °o „x 



ds 



-J2 ^Q\s)dW\s) -J2 eZ\s)dH\s) 
i=i i=i 
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where we have used the abbreviations for ip = f,l as follows: 

' (Py{t) = ipy{t,y{t),q{t),z{t),ut), 

Vuit) = (puit,y{t),q{t),z{t),Ut), 



(3.4) 



Py{t, y{t) + \{y%t) - y{t)),z{t) + X{z%t) - z{t)),u{t) + K^^t) - u{t)))dX, 
^,{t, y{t) + \{y'{t) - y{t)), z{t) + X{z%t) - z{t)), u{t) + X{u%t) - u{t)))dX, 
ifgit, y{t) + Xiq'it) - y{t)), z{t) + A(g^(t) - ^(t)), ^(t) + X{u'{t) - u{t)))dX, 



^lit) = / ^t, y{t) + X{y'{t) - y{t)),z{t) + X{z%t) - z{t)),Ht) + H^'it) - u{t)))dX. 
Jo 

Thus by Lemma [2.41 again, we get 

E sup \y%t) - y{t) - eY{t)\^ + E [ \q%t) - q{t) - eQ{t)\^dt 

0<t<T Jo 

+ E [ \\z^'{t)-z{t)-eZit)\\l^^,.)dt 
Jo „ 



E 



im - fyitwit) + im - m)Q{t) + cat) - umm 



(3.5) 



+ Cfm - fumn{t) - u{t)) 



where 



Ke^ ■ a{e), 



a(e) = E 



2 H 

dt 



Cm)-fy{m{t) + CrM-m)Qii) 



+ Cm - fM)z{t) + Cm) - umnit) - m 



dt. 



Consequently, using Lemma 13.21 and Assumption 13.11 by the dominated convergence the- 
orem we can deduce 



limQ:(£:) = 0. 

e->-0 



Then the lemma follows from above and (13.51) . 



□ 



Lemma 3.4. Under Assumptions \3. 1^3. 2\f using the abbreviations Ili3.4\ ) we have 

Jiu'i-)) - J{u{-)) = eE(j)y{y{0))Y{0)+eE [ ly{t)Y{t)dt + eE I lq{t)Q{t)dt 

+eE I h{t)Z{t)dt + eE I lu{t){u{t) - u{t))dt + o{e). 
Jo Jo 
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Proof. After a first order development, we have 
J{u%-)) - J{u{-)) 



+ E [ ll{t){f{t) - y{t))dt + E f %{t){q%t) - q(t))dt 
Jo Jo 

+ E [ ll{t){z'{t) - z{t))dt + E [ ll{t){u'{t) - u{t))dt 
Jo Jo 



=££;0,(y(o))y(o) + Ec^yimWi^) - m - erm 



+ E 



'vim + Kfio) - m)) - Mvm 

+ eE [ ly{t)Y{t)dt + E [ ly{t){y%t) - y{t) - eY{t))dt 
Jo Jo 

+ E f{%{t)-ly{t)W{t)-y{t))dt 
Jo 

+ eE I lg{t)q{t)dt + E I lg{t){q%t) - q{t) - sQ{t))dt 
Jo Jo 

+ E f {ht)-l,mq^{t)-q{t))dt 



+ 



eE I l,{t)Z{t)dt + E [ l^{t){z%t) - z{t) - £Z{t))dt 
Jo Jo 



+ E / (llit) - Um^^t) - z{t))dt 



+ E / lu{t)e{u{t) - u{t))dt + E / {ll{t) - lu{t))e{u{t) - u{t))dt 



T 



eE(py{y{Q))Y{Q)+eE ly{t)Y{t)dt + eE lq{t)Q{t)dt 



+ eE k{t)Z{t)dt + eE lu{t){u{t) - u{t))dt + P{e), 
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where /3{e) is given by 

f3ie) = E<Py{y{0)WiO) - y(0) - ey(0)) 



-E 



<Pyim + A(/(o) - y(o))) - ^yim) 



+E / lyit)ifit) - y{t) - eY{t))dt + E / (/^(t) - ly{mf{t) - y{t))dt 



l,{tW{t) - q{t) - eQ{t))dt + E / mt) - k{t)W{t) - q{t))dt 



-E 



+E j Ut){z%t) - z{t) - eZ{t))dt + E I {ll{t) - Ut)){z'{t) - z{t))dt 

+E [ (llit) - l,{t))eiuit) - u{t))dt. 
Jo 



Thus combining Lemma I3.2[ Lemma 13.41 and Assumption I3.2[ by the dominated conver- 
gence theorem we conclude that /3(e) = o{e). □ 

Jlu"^) — J(u) 

By Lemma [3.41 and the fact that hm > 0, we can further deduce 

e^0+ e 



Corollary 3.5. Under Assumptions \3. 1^3. 21 we have the variation inequality below 

E(t)y{y{0))Y{{])+E f ly{t)Y{t)dt+E f ly{t)Y{t)dt 

J, J^ T ° 

+E I h{t)Z{t)dt + E lu{t){u{t) -u{t))dt>0. 
Jo Jo 



(3.6) 



4 Necessary and sufficient optimality conditions 

We first introduce the adjoint equation corresponding to the variational equation (13. 3p : 



dk{t) 



f;{t)k{t) + ly{t) 



dt-Yl 



1=1 



rAt)k{t) + i^.{t) 



dW\t) 



E 

i=l 



f:^{t)k{t) + iAt) 



dH\t) 



(4.1) 



[A;(O) = -0,(y(O)), 0<t<T, 



where /*, /*,and /*, are the dual operators of fy, fqi and /^i, respectively. 

Under Assumptions 13. 1113. 21 by Lemma 12.11 it is easy to see that the above adjoint 
equation has a unique solution k{-) G 5^(0, T; M"). Then we define the Hamiltonian 
function H : [0, T] x x W^<^ x x [/ x ^ by 



H{t, y, q, z, u, k) = {k, -f{t, y, q, z, u)) + l{t, y, q, z, u) 



(4.2) 
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and rewrite the adjoint equation in the Hamiltonian system form: 

f dk{t) = -Hy{t, ^(t), Z{t),U{t),k{t))dt 

d 

- J2 H% y{t),q{t),z{t),uit),k{t))dW\t) 



i=l 
oo 



(4.3) 



- J2 HAt, y{t),<l{t),z{t),u{t), k{t))dH\t) 

y k{o) = -Mvm- 

Now we are ready to give the necessary conditions for an optimal control of Problem 

EH 

Theorem 4.1. Under Assumptions \3. 1)^37^ if {u{-);y{-),q{-),z{-)) is an optimal pair of 
Prohlem \3.1\ then we have 



Hu{t, y{t-), q{t), z{t), u{t),k{t-)){u - u{t)) > 0, Vm G U, a.e. a.s., 
where k{-) is the solution to the adjoint equation (14. ip . 
Proof. By (13. 3p and (I4.ip . applying Ito formula to {Y{t), k{t)) we have 



(4.4) 



E(t)y{y{0))Y{0) + E [ ly{t)Y{t)dt + E I U{t)Z{t)dt + E f lu{t){u{t) - u{t))dt 
^ Jo Jo Jo 

rT rT 



= -E {k{t),f^{t,y{t),q{t),z{t),Ut){u{t)-u{t)))dt + E lu{t){u{t) - u{t))dt. 
Jo Jo 

Then noticing the definition of Hamilton function (14. 2 p and the variational inequality 
(13. 6p . for any w(-) G A, we have 

r-T 



E 



H^{t, y{t), q{t), z{t), u{t),k{t)){u{t) - u{t))dt > 0, 



which implies (14. 4p . □ 

We then consider the sufficient conditions for an optimal control of Problem 13.11 

Theorem 4.2. Under Assumptions\3JMM ^et («(■); |/(-), g(-), ^(■)) be an admissible pair 
and fc(-) be the unique solution of the corresponding adjoint equation (14. 3p . Assume that 
for almost all (t, uj) G [0,T]xQ , H{t, y, q, z, u, k{t)) and (j){y) are convex w.r.t. {y, q, z, u) 
and y, respectively, and the optimality condition 

Hit, y{t), q{t), z{t),u{t),k{t)) = min H{t, y{t), q{t),z{t), u, k{t)) 
holds, then {u{-); y{-) , q{-) , z{-)) is an optimal pair of Problem \3.1\ 

Proof. Let («(■);?/(■), g(-), 2;(-)) be an arbitrary admissible pair. It follows from the form 
of the cost functional (13. 2p that 



J{u{-))-J{u{-)) 



T 



E 
h + h 



lit, yit),qit),zit),uit)) - lit, yit),qit), z(t), ti(t)) 



dt + E 



(4.5) 
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where 



and 



h = E 



l{t, y{t),q{t),z{t),u{t)) - l{t, y{t),q{t),z{t),u{t)) 



h = E 



dt 



Due to the convexity of </>, applying Ito formula to {k{t), y{t) — y(t)), we have 

h =E[cPiym - mm > En^yiym^yi^) - m)] = -E[{m,yio) - m)] 

= -E [ {Hy{t,y{t),q{t)rz{t),u{t),k{t)),y{t) - y{t))dt 



{Hi{t,y{t),m,m,Ht),m,Q\t) - <i\t))dt 

i=l -^0 

-Y^E f {Hlit,yit),q{t),zit),u{t),kit)),z\t) ~ z\t))dt 
i=i -^0 

-E [ {f{t,y{t),q{t),z{t),u{t)) - f{t,y{t),q{t),z{t),u{t)),k{t))dt 
Jo 

-Ji + J2, 



where 



Ji= E {Hy{t,y{t),q{t),z{t),u{t),k{t)),y{t)-y{t))dt 
Jo 

+ Ve / {Hl{t,y{t),m,m,uit),kit)),q\t) - (tit))dt 

i=l "^0^ 

/ {Hiit,m,m,m,u{t),k{t)),z\t) - z\t))dt 



i=l 



and 



Using the definition of the Hamiltonian function (14.21) again, we have 



J2 = -E {fit, y{t), q{t), z{t),u{t)) - f{t, y{t),q{t), z{t),u{t)),k{t))dt. 



h =E 



E 



lit, y{t),q{t),z{t),u{t)) - l{t, y{t),q{t), z{t),u{t)) 



dt 



H{t, y{t),q{t),z{t),u{t), k{t)) - H{t, y{t), q{t), z{t),u{t), k{t)) 



dt 



+E / {f{t,y{t),q{t),z{t),u{t)) - f{t,y{t),<l{t),z{t),u{t)),k{t))dt 

Jo 
J3 — J2, 



where 



Jh = E 



H{t, y{t),q{t),z{t),u{t), k{t)) - H{t, y{t), q{t), z{t) , u{t) , k{t)) 



(4.6) 



(4.7) 



dt. (4.8) 
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Since H{t,y, q, z,u, k{t)) is convex w.r.t. {y,q,z,u) for almost all {t,uj) G [0,r] x Q, it 
turns out that 

H{t, y{t), q{t), z{t),u{t),k{t)) - H{t, y{t), q{t),z{t),u{t), k{t)) 
>{Hyit, yit),qit),m,uit), k{t)),y{t) - y{t)) 



+ Y.^H% -z{t)Mt)Mt)). q\t) - q\t)) 



oo 



(4.9) 



+ j2{Hi{t, y{t), m, m, ^w, ^w), w - w) 



i=l 



+ {Hu(t, y(t),q{t),z{t),u{t), k{t)),u{t) - u(t)), a.s. a.e. 

On the other hand, for almost all {t,uj) G [0,T] x Q, u H{t,y(t),q{t),z(t),u,k{t)) 
takes its minimal value at u{t) in the domain U, thus 

{Huit,y{t),q{t),z{t),u{t),k{t)),u{t) -u{t)) >0, a.s. a.e. (4.10) 

Therefore, by (Ii^ - (I4.10I) we first have 

Js > Ji. (4.11) 

By fICTD . together with (|13D-(!i2D, it follows that 

J{u{-)) - J{u{-)) = h + h = ( J3 - J2) + (- Ji + J2) > {Ji - J2) + {-Ji + J2) = 0. 

Due to the arbitrariness of tt(-); we conclude that u{-) is an optimal control process and 
thus («(■); !/(•), g(-), z{-)) is an optimal pair. □ 



5 Applications in BLQ problems 

In this section, we will apply our stochastic maximum principle to the so-called BLQ 
problem, i.e. minimize the following quadratic cost functional over u{-) G A: 

J{u{-)) ■.=E{My{0),y{0)) + E r {E{s)y{s),y{s))ds + E {F\s)q\s),q\s)}ds 

(5.1) 

+ y^E {G\s)z\s),z\s))ds + E / {N{s)u{s),u{s))ds, 
Jo Jo 



i=l 



where the state processes {y{-), q{-), z{-)) are the solution to the controlled linear backward 
stochastic system as follows: 

d 00 



dy{t) 



A{t)y{t) + J2 B\t)q\t) + C\t)z\t) + D{t)u{t) 



i=l 



1=1 



dt 



+ q'dW\t) + Y z'dWit) 



(5.2) 



1=1 



i=l 



I yiT) = c 

To study this problem, we need the assumptions on the coefficients below. 
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Assumption 5.1. The {<^t,^ ^ t < T}-predictable matrix processes A : [0,T] x Q ^ 
^nxn^ Qi : [0, T] X ^ M"><", i = 1, 2, ■ ■ ■ , d, [0, T] X ^ M"^", z = 1, 2, ■ ■ ■ , D : 
[0,T] X ^] ^ M"x™,£; : [0,T] X ^] ^ : [0,T] x ^ R"><",i = 1,2, : 

[0, T] X ^ M"^", 2 = 1, 2, ■ ■ ■ , : [0, T] X -> R™^™ and tlie ^r-measurable random 
matrix M : — )■ M"^" are uniformly bounded. 

Assumption 5.2. Tlie state weigliting matrix processes F*, G*, tlie control weighting 
matrix process and the random matrix M s. symmetric and nonnegative. 

Moreover, is a.e. a.s. uniformly positive, i.e. N > 61 for some positive constant 6 a.e. 
a.s. 

Assumption 5.3. There is no further constraint imposed on the control processes, i.e. 
^ = < u(-)\u(-) is — 'predictable with values in M™" and E / \u{t)\'^dt < oo}. 



From Assumption 15.31 we know that ^ is a Hilbert space. If we denote the norm of 

[? 

by II ■ ||_4, then for any control process u(-) G A, \\u{-)\\_4^ = E\ / \u{t)\'^dt. 

Under Assumptions 15.11 by Lemma 12.31 we first know that the linear BSDE (15. 2p in 
BLQ problem has a unique solution and thus the BLQ problem is well-defined. Then, 
under Assumptions I5.ltl5.3l we will demonstrate that BLQ problem has a unique optimal 
control. 

Lemma 5.1. Under Assumptions 15. 1 \ \5. 31 the cost functional J is strictly convex over A 
and hm J{u{-)) = oo. 

Proof. The convexity of the cost functional J over A is obvious. Actually, since the 
weighting matrix process N is uniformly positive, J is strictly convex. In view of the 
nonnegative property of M, E, F^, G* and the strictly positive property of N, we have 

|2j. _ / M|2 



J{u{-))>6E / \u{t)\'dt = SMWa- 
Jo 

Therefore, lim J{u{-)) = oo. □ 

ll"(-)IU-5-oo 

Lemma 5.2. Under Assumptions 15. 1^5. 31 the cost functional J is Frechet differentiable 
over A and its Frechet derivative J' at any admissible control process u{-) & A is given 
by 

{J'{u{-)),v{-)) =2E r{E{t)y-{t),Y^{t))dt + 2j2E {F\t)r{t),Q^%t))dt 
Jo Jo 

+ 2^F / (G'(f)^*"(t),Z™(t))dt + 2E / {N{t)uit),vit))dt 
i=i Jo Jo 

+ 2E{My-{0),Y^{0)), 

where v{-) E A is arbitrary, {Y^,Q^,Z^) is the solution of BSDE (15. 2p corresponding to 
the control process v{-) G A and the terminal value 0, and (?/"(■)) 9"(")5 ^"(O) ^'^^ ^^e state 
processes corresponding to the control process u{-). 
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Proof. For any ti(-) G we set 

A J = J(n(-) + v{-)) - J{u{-)) - 2E r {E{t)y\t),Y^{t))dt 



d oo „'j' 

2Ve / (F^(t)g™(t),g™(t))rft-2 / {G\t)z'''{t),Z''"{t))dt 

i=i i=i 



-2E I {N{t)u{t),v{t))dt-2E{My''{0),Y''{0)). 



By the definition of cost functional (15. ip . we have 

AJ=E(My^(0),F^(0)) / (E(s)y''(s),y^(s))(is + / {F\s)Q'''is),Q'''is))ds 

Jo Jo 

oo „T „T 

+ y^E {G\s)Z'''{s),Z'\s))ds + E / (A^(s)i;(s),t;(s))ds. 

Then it follows from Assumption 15.11 and a priori estimate (12.31) that 
lAJl < K 



T pT pT ■ 

E snp \Y''{t)\^ + E I \Q''{t)\^dt + E \\Z''{t)\\%^^.dt + E \vit)\^dt 



0<t<T 
f-T 



< KE ! \v{t)\^dt = K\\v{- 
Jo 

Consequently, we have 



hm II , , II = 0, 
IIOIU-^o ||v(-)|U 

which implies that J is Frechet differentiable and its Frechet derivative J' is given by 

(ED. □ 

The strict convexity and the Frechet differentiability of J deduced from Lemmas 15.11 ^ 
15.21 lead to the lower semi-continuity of J, thus the following lemma is applicable to J 
and A in our BLQ problem. 

Lemma 5.3. (Proposition 1.2 of Chapter II in f^) Let A be a reflexive Banach space and 
J : ^ I— )■ he a convex function. Assume that J is lower semi- continuous and proper, 
and consider the minimization problem 

inf Jiu). 

If the function J is coercive over A, i.e. 

lim J{u) = oo, 

\\u\\j^—^oo 

then the minimization problem has at least one solution. Moreover, if J is strictly convex 
over A, then the minimization problem has a unique solution. 
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By Lemma [5.31 we can immediately conclude 

Theorem 5.4. Under Assumptions 15. i | j5. 31 BLQ problem has a unique optimal control. 

In what follows, we will utilize the stochastic maximum principle to study the dual 
representation of the optimal control to BLQ problem and construct its stochastic Hamil- 
ton system. As in section 4, we first introduce the adjoint forward equation corresponding 
to an admissible pair {u{-); y{-) , q{-) , z{-)): 



dk{t) = \^A*{t)k{t) - 2E{t)y{t)jdt + J2 [B'*{t)k%t) - 2F'{t)q'{t)jdW'{t) 

+ Yl ('^"(^)^W - '^G\t)z'{t)\ dH\t) (5.4) 
i=i ^ ^ 
[A;(0) = -2My(0). 

Also we define the Hamihonian function H : [0, T] x x M" x M"^'^ x x [/ x M" ^ 

by 



Hit,y,q,z,u,k) = -{^^k, A{t)y + Y,B\t)q' + Y,C\t)z' + D{t)u\ (5.5) 

d oo 
i=l i=l 

Then the adjoint equation can be rewritten as a Hamiltonian form: 

d 

dk{t) = -Hy{t, y{t),q{t), z{t), u{t),k{t))dt - J/;(f, y{t),q{t), z{t),u{t),k{t))dB\t) 

1=1 

oo 

- J2 HAt, y{t-),q{t),z{t),u{t),k{t))dH\t) (5.6) 
1=1 

[kiO) = -2My{0). 



Under Assumption 15. for each admissible pair {u{-);y{-),q{-),z{-)), by Lemma [2TT] the 
adjoint equation (15. 6p has a unique solution A;(-). 

It is time to give the the dual characterization of the optimal control. 

Theorem 5.5. Under Assumptions 15. i l l 5. 31 BLQ problem has a unique optimal control 
and the optimal control is qiven by 

u{t) = -^N-\t)D*{t)k{t-), a.e. a.s., (5.7) 

where k{-) is the unique solution of the adjoint equation (15. 4p (or equivalently, (15. 6p ) 
corresponding to the optimal pair {u{-)]y{-),q{-),z{-)). 
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Proof. By Theorem 15 ■4[ we know the existence and uniqueness of optimal control to BLQ 
problem and denote the optimal control by u{-). We only need to prove u has an expression 
as in f l5.7p . For this, let {y{-), q{-), z{-)) be the optimal state processes corresponding to m(-) 
and k{-) be the unique solution of the adjoint equation (15. 6 p corresponding to the optimal 
pair {u{-);y{-),q{-),z{-)). By the necessary optimality condition (14 ■4p and Assumption 
I5.3[ we have 

Hu{t, y{t-),q{t),z{t),u{t), k{t-)) = 0, a.e. a.s. 
Noticing the definition of H in (15. 5p . we get 

2N{t)u{t) + D*{t)k{t-) = 0, a.e. a..s. 

Then the claim that the unique optimal control u{-) satisfies (15.70 follows. □ 

Finally we introduce the so-called stochastic Hamilton system which consists of the 
state equation (15.20 . the adjoint equation (15.40 (or equivalently, (15.60 ) and the dual rep- 
resentation (15.70 : 

(d oo \ 

1=1 i=l ^ 

oo 

+ q'dW%t) + J2 z'dH\t) 

i=l i=l 

y{T) = e, 



dk{t) = \^A*{t)k{t) - 2E{t)y{t)jdt + J2 [B"{t)k\t) - 2F'{t)q\t)jdW%t) 

+ J2(c"{t)k{t) -2G\t)z\t)]dH\t) (5.8) 
1=1 ^ ^ 
A:(0) = -2M?/(0), 

Ut = ~N-\t)D*it)k{t-). 

Clearly this is a fully coupled forward-backward stochastic differential equation (FBSDE) 
driven by (/-dimensional Brownian motion W and Teugel's martingales {H^}°li, and its 
solution is a stochastic processes quaternary {k{-),y{-),q{-),z{-)). 

Theorem 5.6. Under Assumptions 15. i l l 5. 31 the stochastic Hamilton system (15. 8p has a 
unique solution {k{-),y{-),q{-), z{-)) G S%{0,T;W) x 5^(0, T;R") x M|(0,r;M"^^) x 
1%{0,T;W), where u{-) is the optimal control of BLQ problem and (?/(■), g(-), z{-)) are its 
corresponding optimal state. Moreover, 

E snp \k{t)\^ + E snp \y{t)\^ + E [ \q{t)\''dt + E [ \\z{t)\\f2(^u)dt ^ KE\^\^. (5.9) 

Proof. The existence result follows from Theorem 15.51 and the uniqueness result is obvious 
once a priori estimate (15. 9p holds. But noticing Assumptions I5.m5.3l and using Lemmas 
]2] and [231 we can deduce (15. 9 p immediately. □ 
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In summary, the stochastic Hamihon system flS.Sp completely characterize the optimal 
control of BLQ problem in this section. Therefore, solving BLQ problem is equivalent 
to solving the stochastic Hamilton system, moreover, the unique optimal control of the 
stochastic Hamilton system can be given explicitly by (15. 7p . 
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